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(54) METHOD AND APPARATUS FOR DUAL RESOLUTION 

ANALYSIS OF A SCENE 



(71) I, JAMES EDMOND GREEN, a 
citizen of the United States of America, of 
Post Office Box 734, Fayetteville, State of 
Tennessee, United States of America, do 

5 hereby declare the invention, for which I 
pray that a patent may be granted to me, 
and the method by which it is to be 
performed, to be particularly described in 
and by the following statement:- 

10 The present invention relates to a scene 
analysis apparatus and methods and more 
particularly, to a method and apparatus in 
which a a scene is scanned at two different 
resolutions. Such a method and apparatus 

15 are described in U.K. Specification No. 

1505763! , . 

In many areas of particle analysis, such 
as, blood cell analysis or pap smear analysis, 
the particles of interest are widely distri- 

20 buted in a field and are surrounded by many 
particles of no interest at all. For example, 
white blood cells may be surrounded by 
hundreds of red blood cells while cancerous 
or dysplastic cervical cells may be sur- 

25 rounded by tens-to-thousands of normal 
cervical cells and debris. 

It is desirable to analyze in detail only the 
particles of interest in the scene. This can be 
accomplished by the detailed analysis of all 

30 objects in order to exclude the unwanted 
objects. However, this technique is very 
time-consuming and therefore relatively im- 
practical from a commercial standpoint. 
Alternately, one can use a single sensor to 

35 search for particles of interest at a low 
resolution and then switch the sensor to a 
higher resolution for analysis when a parti- 
cle of interest is found in the sample. 
However, this method requires mechanical 

40 or electrical switching of the analysis resolu- 
tion with a concomitant limitation of a single 
mode of operation at any given time. 

The use of simultaneous multiple resolu- 
tion analysis of a plurality of fields overcony 

45 es the limitations of prior art analysis 



systems. Dual resolution scanning systems 
have been used by several workers. Aldrich 
et al disclosed in U.S. Patent No. 3,448,271 
a dual resolution scanning system which 
centers and tracks celestial objects. In this 
system two coaxial images at different mag- 
nifications are employed to acquire and 
track stars or the solar disc. The scanned 
output of a single sensor is used as an on or 
off-axis signal m a feedback loop to center 
the star image on the optical axis. No image 
analysis of the celestial objects is performed 
or envisioned. In fact, the superimposed 
images on the single detector would confuse 
an attempt to analyze the scanner output. 

Similarly, Ward in U.S. Patent No. 
3,614,449 discloses a dual resolution scan- 
ning system for acquiring and tracking a 
distant source of light (the target). Ward 
describes the same type coaxial dual resolu- 
tion system in which both images are pro- 
jected onto a single sensor. In addition, 
there is a second sensor responsive to a 
narrow spectral band ranging source emit- 
ted by the system and reflected by the 
target. Although the ranging subsystem is 
functionally separate from the dual resolu- 
tion centering and tracking system, it is 
housed in the same assembly for compact- 
ness in a NASA application. Again, there is 
no image analysis disclosed or envisioned by 
either the acquiring-tracking system or the 
ranging subsystem. 

Other uses of dual resolution scanning 
have been disclosed, such as Gard in U.S. 
Patent No. 3,804,976, which uses the scan- 
ned images for display purposes. However, 
no image analysis is revealed or envisioned 
by these disclosures. 

Adkins in U.S. Patent No. 3,864,564 
discloses a dual resolution scanning system 
in which a low resolution, one dimensional 
scan is used for finding and positioning a 
blood cell, and a high resolution two- 
dimensional scan is used to analyze the cell. 
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The high resolution sensor is a v jdeconjyj>e 



T.V. camera which is well suited to the 
analysis of the centered blood cell. Howev- 
er, the low resolution sensor is a single 
5 photodetector. The image is swept across 
the photodetector by means of a rotating 
mirror thereby producing a one-dimensional 
line scan of the low resolution scene. The 
low resolution signal is used only to detect 
10 and center the cell for analysis by the high 
resolution sensor. Analysis by the low re- 
solution portion of the system is not dis- 
closed or envisioned. In fact, any analysis 
using the one-dimensional information pro- 
15 vided by the low resolution line scanner 
would be difficult and limited. 

A system such as that described by 
Adkins has several limitations. To use the 
blood cell example, if there were several 
20 classes of cells detected by the low resolu- 
tion acquisition and centering system, and it 
was desired to perform a detailed analysis 
on only a subset of these cells, it would be 
necessary to acquire and center all detected 
25 cells and perform a detailed analysis on 
them all using Adkins system. Thus much 
additional unnecessary effort would be 
necessary. In the case of pap smears, where 
there may be thousands of normal cells to 
30 every cancer cell, the extra work necessary 
to perform a detailed analysis on every 
normal cell to find a single cancer call would 
render a commercial application imprac- 
tical. ... , . 
35 In many cases it is possible to derive 
enough information from a preliminary low 
resolution analysis to determine if a de- 
tected object warrants further detailed 
analysis. The present invention provides for 
40 such dual resolution analysis with the low 
resolution analysis of a large field occurring 
simultaneously with the high resolution 
analysis of an object of interest. Using the 
previously mentioned blood cell example, 
45 artifacts such as dirt or large stain crystals 
can and do occur on blood smears. A simple 
preliminary measurement of object size is 
usually adequate to allow exclusion of these, 
artifacts from the detailed high reso ution 
50 analysis. A more complex low resolution 
analysis can be employed if desired. 

It is accordingly, a general object of the 
invention to provide a method and appar- 
atus for scene analysis which overcomes the 
55 limitations of the prior art systems. 

Thus from a first aspect the prcscn 
invention consists in a method for dual 
resolution analysis of a scene comprising the 
steps of searching the scene at a low 
60 resolution to detect an object therein; ana- 
lysing the detected object to determine if it 
is an object of interest; and. analysing the 
object of interest at a .higher resolution 
while continuing to search the scene at the 
65 tower resolution to detect any other objects 



therein. , . . 

From a second aspect the invention con- 
sists in a dual resolution scene analysis 
apparatus comprising means for detecting 
when an object is encountered during the 70 
low resolution search; means for analysing 
the detected object to determine if it is an 
object of interest; means for analysing the 
object of interest at a higher resolution; 
means responsive to said detected object 75 
analysing means for initiating the object ot 
interest analysis by said higher reso ution 
analysing means while said low resolution 
searching means continues to search the 
scene to detect any other objects therein. 80 

In order that the present invention may 
be more readily understood a preferred 
embodiment thereof will now be described 
by way of example and with reference to the 
accompanying drawings, in which: 85 

Figure J is a diagrammatic perspective 
view of a dual resolution, analysis apparatus 
constructed in accordance with the present 

invention, OA 
Figure 2 is a block diagram of the electnc- 90 
al circuitry for analyzing the large field at 
low resolution, determining if an object of 
interest is present in the scene, and deter- 
mining the coordinates thereof; 

Figure 3 is a detailed functional block !o 
diagram of the data flow in a representative 
low resolution analysis; 

Figures 4A through to 4D illustrate va- 
rious relationships between the low reso u- 
tion field and the higher resolution field; 100 

and ' 

Figure 5 is another diagrammatic view 
illustrating an alternative embodiment of 
the dual resolution analysis apparatus. 

Turning now to the drawings, Figure 1 litt 
illustrates in diagrammatic form and pers- 
pective view, the dual resolution analysis 
apparatus of the present invention. A sam- 
ple carrier 1, which can be moved in both 
the X and Y directions by means of drive 110 
motors 2 and 3, contains a sample 4 which 
has a plurality of objects of interest 5a, 5b, 
and 5c. In the blood cell embodiment, the 
sample carrier 1 normally composes a glass 

slide upon which the blood sample 4 is 115 
spread in a conventional manner. It will be 
appreciated that the blood sample will 
contain many red blood cells, a number of 
dispersed white blood cells of interest i.e. 
cells 5a, 5b and 5c etc., white cell clumps 120 
platelets, platelet clumps, and artifacts such 
as dust particles and stain percipitate. 

A primary optical objective 6, such as a 
microscope objective, forms an image of an 
area of the sample. The area of the sample 125 
which is desicnatcd "a low resolution field 7 
is imaged bythc primary objective 6, beam 
splitter 6b and a low resolution secondary 
optic 8 onto a low resolution sensor 9. The 
image of the low resolution field 7 on the iju 
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low resolution sensor 9 is indicated by he 
reference numeral 10. A relatively smaler 
area of the sample, termed a "higher resolu- 
tion field" 11, is imaged by Ae primary 

5 objective 6 and a secondary high resolution 
optic 12 onto a high resolution sensor 13. 
The high resolution image on the high 
resolution sensor 13 is identified by the 
reference numeral 14. 

10 Conventional opto-electncal image scan- 
ners can be used for the low and high 
resolution sensors 9 and 11, respective^ 
For example, the opto-electncal scanning 
sensors can comprise a television camera 

IS image dissector, photodiode array, or toe 
like The opto-electrical sensors convert the 
respective images into electrical signals in a 
well known manner. 
In the preferred embodiment the low 

20 resolution signal output from sensor » 

20 apiS m line 14b an*a is used to.analvse 
thelow resolution field and determine if an 
object of interest is present and if so to 
establish the position of said object of 

25 interest (white cell) such as 5a 5b or 5c 
relative to the higher resolution field 11, so 
that appropriate signals can be generated to 
move tne ooje« 

resolution field for more detailed analysis. 

30 In the embodiment illustrated in Figure : 1, 
the object of interest is moved into toe 
higher resolution field 11 by moving ; the 
sample carrier 1 in the X and Y Erections by 
means of drive motors 2 and 3. It mil be 

35 appreciated that the . equivalent relauve 
movement can be achieved by moving the 
optical system and leaving the sample ^car- 
rier fixed. Such an arrangement is illustrated 
Si Figure 5 and will be discussed subse- 

40 Representative circuitry for analyzing the 
large field at low resolution for a new object 
of Interest, calculating its coordinates and 
producing appropriate output signals for 
45 actuating the drive motors 2 and 3 to move 
£e object of interest into the higher resolu- 
tion field 11 is depicted in block diagram 
form in Figure 2. The low resolution sensor 
s& output on line 15 is inputed into a low 
50 resolution analyzer 16. A number of diffe- 
rent analyzers can be used for the low 
resolution analysis depending on the charac- 
teristics of the particular sample under 
analysis. One such analyzer b described! in 
55 UK Patent Specification 1449501. This 
analyzer would be employed if an extensive 
low resolution analysis were desired. 

The low resolution image analyzer to 
outputs a load signal on line 17 when i 
60 recognizes an object which warrants further 
detailed analysis. Assuming that the low 
resolution sensor 9 scans in a raster fashion 
and has 64 x 64 resolution elements (je- 
selsi, the position of the scanner can be 
65 tracked by means of 64 bit X and Y counters 
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19 and 20 respectively. The X and Y 
counters are reset by means of reset line 21 
before the beginning of each scan During 
the scan, clock line 18 increments the X 
counter 19 each time the scanner senses one 
resel on a horizontal scan line. At die end of 
each horizontal scan line, the X counter 
overflows and the overflow signal, on over- 
flow line 22, is used to increment the i 

counter 20. . ... v „„„ 

Associated with the X and with Y coun- 
ters 19 and 20 are corresponding X mi Y 
registers 23 and 24, respectively. The X 
register 23 is connected to the X counter and 
the Y register 24 is connected to the Y 
counter sotfiat when the load" signal b 
present on line 17 the contents of the X 
counter are transferred to the X register and 
Se contents of the Y counter are uansfer. 
red to the Y register. Thus, when an object 
3 interest is analyzed by the low resolution 
Snaly^r 16, the position of that caviar 
object in the low resolution field 7 is stored 
in the X and Y registers 23 and 24. 

The outputs of the X and Y registers 
apjSr on output busses 25 and 26 The two 
outwit busses feed into conesponding add/ 
fficSrs 27 and 28 in which the position 
of Ae higher resolution field 11 relative to 
£e low ^solution field 7 is subtracted (or 
added as the case may be) to produce the 
proper X-move and Y-move signak on 
output lines 29 and 30. The X Mid Y motor 
drive circuitry 31 and 32 ttansfonnsthe X 
and Y move signals into electrical signak qn 100 
lines 35 and 36 respectively appropriate to 
produce the movements represented by the 
X-move and the Y-move signals. 

It should be noted that the Figure 2 
circuitry will have stored the P°»t.on of the 105 
last object in the low resolution field 7 at the 
end of a scan. However, it ^ flg 
ated that it is possible to inhibit _the load 
signals after the first encountered object o 
interest so that the position of the first 110 
objecT is saved instead of the last object 
The X-overflow from Y counter 20 is used 
to inhibit the command of the motor move- 
ments through an "end of frame move 
Sle" circuit until the final change in 115 
the X and Y registers 23 and 24 

If low resolution analyzer is of the kind 
described in U.K. Patent Specification i No 
1449501 and shown in the functional block 
diagram of Figure 3, is. employed in the 120 
embodiment being described, the X and I Y 
position signals are derived from the : stored 
oartial features of the cells. This is illus- 
trated in Figure 3 by the X and Y pos.tion 
ou puts. The position information is 
obtained from the low resolution sensor and 
Udelaved or not delayed in the same 
maSneras the cell data" The Y-oyerflow 
Sal is replaced by an end of analysis signal 
to trigger the move enable. 
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, _ n( nhieetive 6 is sufficient to allow the mirrors 

The preceding brief discussion o f an ^J^'^^^lv positioned between it 

illustrated relatively complex low resolution to be "3' e 3 e p maintainin g relatively 

analyzer is directed to the data processing of »»f^ , JJPf wn,,e ma ' 

a single object of interest. It will be appreci- uniform focus. . _ 

j.u** m .,u; M i» ak;m*c nf interest can b< 



a SingIC UUJCH Ul nitwit..*-.. « " -rr 

ated that multiple objects of interest can be 
handled with suitable storage and proces- 
sing capability. 

It will be appreciated that when the object 
of interest detected by the low resolution 
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worm mm*. .... i »•..„ 

It will be appreciated that the relative 
movement of higher resolution field with 
respect to the object of interest can be 
accomplished either with or without a cor- 
responding relative movement of the low 



70 



of interest detected by the low nnotatm ^^^^^Smd embodi- 

analyzer has been moved into the field of resolution lie vu.m i g ^ 

view of the high resolution sensor, the ment, Dotn uu^ »w «^ ^ o{ 

. i ^ :«:» M »/4 o now e/v»np in 



75 



view oi UK , 

movement also positioned a new scene in 
the field of view of the low resolution 
sensor. While the high resolution Jield is 
being scanned and analyzed by the nigh 
resolution sensor and high resolution analy- 
sis means, the low resolution field can be 
scanned and analyzed by the low resolution 
sensor and low resolution analyzer to deter- 
mine if there is another object of interest in 
the new low resolution field. Thus, when the 
detailed scan of the object in the high 
resolution field is complete, the X and i 
registers 23 and 24 will contain the coordin- 
.°_ -f .. ~ui*r* nf interest if one was 



45 



50 



55 
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fields are moved relative to the object of 
interest to bring the object of interest into 
the higher resolution field. However, in the 
preferred embodiment there is no relative 
movement between the two resolution fields 
during the relative movement of the object 
of interest into the higher resolution field. 

The output from the higher resolution 
sensor 13 is applied to a suitable object 
analyzer 37. One such analyzer is described 
in U.K. Patent Specification No. 1449501. 

Thus, there is provided a method and 
apparatus for analyzing a scene at a low 
.:i o n nKiprt of interest is 
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registers 13 and 24 will contain the coordin- apparatus ™ « »£ - - . js 

atcs of a new object of interest if one w ■«^ 1 £™£;S object of interest 

present in the low resolution field. This detected, v^*"^,... J rn \,«\ nn while 

f .' ./ .u- :.,mn«;nn whirh allows the 
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feature of the invention which allows the 
simultaneous or nearly simultaneous analy- 
sis of the sample at multiple resolutions 
results in considerable increase in system 
speed over a system which must perform 
these tasks in a sequential manner. 

It should also be observed that the rela- 
tive position of the higher resolution field 1 1 
with respect to the low resolution field 7 as 

, ■' rr: - 1 ir nnlu nnf nf a number Ot 



is analyzed at a higher resolution while 
continuing to analyze the scene at the low 
resolution. In the preferred embodiment, 
the scene comprises a blood samp e and the 
objects of interest are blood cells. 
WHAT 1 CLAIM IS:- . 
1 A method for dual resolution analysis 
of a scene comprising the steps of searching 
the scene at a low resolution to detect an 



95 



with respect to the low resolution field 7 as mc .seen - « - rf d ob j cc , 

shown inV.gurc 1 is only one of a number of ^S^^ Object of interest; 
^JSSX^i^^ and de an r aSg the .object if _mterest at a 



100 



possum- uioiuw».->. « - ; ; , 

of the possible relative positions for the two 
resolution fields. In Figure 4A, the higher 
resolution field 1 lb is shown positioned at 
the center of the low resolution field 7. 
Other locations within the low resolution 
field can be employed as illustrated .in 
*- at* tu« kioh^r iv*crMntinn fie a also 



and, analysing the object of interest at a 
higher resolution while continuing to search 
th! scene at the lower resolution to detect 105 
any other objects therein. 

2 A method as claimed in claim 1 
wherein said continuing low resolution scan- 



field can be employed as »ted m ^^K"^, the sam- 
^££^J£12^£* plereE to at least one of said resolut.on 
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can partially overlap the low resolution field 
as illustrated in Figure 4C or be located 
entirely outside of the low resolution field as 
depicted in Figure 4D. These four arrange- 
ments are not intended to be exhaustive but 
should be construed as being merely illus- 
trated of a large number of possible arrangc- 

™ It has been mentioned previously that it is 
not necessary to physically move the sample 
carrier 1 in order to move an object ot 
interest into the higher resolution field. 
Looking at Figure 5. the sample carrier is 
identified as lb and the sample as 4b. Drive 
motors 2b and 3b arc employed to drive 
movable mirrors 33 and 34 which change the 
area of the sample 4b scanned by ihc high 
and low resolution fields without physically 
moving the sample. Generally this particu- 
lar configuration is practical only it the 
working distance of the primary optical 



iEWS IE « least o^c of said resolution 110 

fields. i - i i 

3 A method as claimed in claim I 

further comprising the step of moving the ^ 
higher resolution field relative to the sample 
to bring each detected object into the higher 1 15 

resolution field. , 

4 A method as claimed m claim 3 
further comprising the step of moving both 
he low and'high^ resolution fields .relate 

to the sample while maintaining the same 1ZU 
relative position with respect to each other. 

5 A dual resolution scene analysis 
apparatus comprising means for detecting 
when an object is- encountered during the 

low resolution search; means for analysing 125 
the detected object to determine if it is an 
object of interest; means for analysing the 
object of interest at a higher resolution; 
means responsive to said detected object 
Sing means for initiating the object of 130 
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interest analysis by .said higher «o lut.on 
analysing means while said low 

searching means wn \r"wJf Serein 
scene to detect any other objects therein. 

6 Apparatus as claimed m claim a. 
wherein said low resolution scanning means 
Sow resolution field o ^ g 
high resolution scanning means have a mgn 
resolution field of view 

7 Apparatus as claimed in claim o, 
where»n P s P aid meanS responsive > to . said ob- 
iect detection means for initiating the oojeci 
iSLnke by sS Ugh resolution scanning 
mlTwhife said llw resolution « 
means are operative to continue to scan he 
Smple to dW any other objects m .the 
sample without moving^ the sample i relative 
to at least one of said resolution fields of 

V ' T Apparatus as claimed in claim 7 
whereuT Sd at least one resolution 6eld b 

the low resolution M»\ . . •_ 6 

9 Apparatus as claimed in claim j 
wherein said low resolution scanning means 
Tol e ative to continue to scan the sample 
without moving the sample relative to the 
imw and hieh resolution fields. 

10 aXi resolution sample scanning 
apparatus comprising means for 
a Mmole- a first opto-electncal image scan 
Seans for producing an output signal 
Sn a sample object is encountered dunng 
Siting; a second opto : electncal image 

rpnresentative of a scanned image, opucai 
SSofLging a low 
field on said first , opto-electncal image 
Sning means and a higher reso unon 
sample field on said second ' opto-e^«ncal 
imaee scann ng means; means tor analysing 
SK?t signal to determine t 4 > m i encoun- 
tered sample object is an object o n eres 
and if so; producing an object of mterest 
output signal; and means responsive jo he 
object of interest output TO? 
the higher resolution sample field relative to 
the sample to bring the encountered sampk 
object into the higher resolution field for 
Snning by said second I »P*£<gj£ £ 
age scanning means while the firs : opto 
electrical image scanning means continues 
to scan the low resolution field to detect any 
other objects in the sample, said continuing 
fow 3tion field scan being performed 
Stout moving the sample relative to at 
least one of said resolution fields. 

U Apparatus as claimed in claim 10 
wherein said optical means -fan WS «g 
low and higher resolution sample fields -.wot 
optical patl which have a common ^oruon 
12 Apparatus as claimed in either oi 
claims 10 or 11 wherein said sample posi- 
tioEg means includes X-Y sample support 
mean? Sid said output signal response 
65 moving means includes X and Y drive 



means for moving said sample support 

T' Apparatus as claimed in claim 10 
wherein sad output signal responsive ; mov- 
mg means moves both the low and higher 70 
Ktion sample fields relative to the 

^Apparatus as claimed in claim 13 
wherein said moving means is operative to 
move Soth the low" and higher resolution 75 
Se fields relative to the sample without 
Bng the relative relationship of the two 

fields with respect to each i otiicr 
15 Apparatus as claimed in any one oi 

claims lOto 14 wherein the higher resolu- 80 
tiSmple field is positioned within the low 

^SJltt ^claimed in any one of 
claims 10 to 14 wherein the higher sample 
Stion field and the low sample resolu- 85 
tion field partially overlap. 

17 Apparatus as claimed in any one oi 
claims 10 to 14 wherein the higher resolu- 
Sample field is positioned outs.de of the 
low resolution sample new. 

18 THe methods for dual resolution 
ana^is hereinbefore described with refer- 
ence to the accompanying drawings. 
6 S Dual resolution analysis apparatus 
substantially as hereinbefore described I with 95 
reference to the accompanying drawings. 
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